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METHOD FOR CAPTURING A PANORAMIC IMAGE BY MEANS OF AN IMAGE 

SENSOR RECTANGULAR IN SHAPE 



The present invention relates to obtaining digital 
panoramic images and displaying panoramic images on computer 
screens . 

The present invention relates in particular to a method 
5 for capturing a digital panoramic image, comprising a step of 
projecting a panorama onto an image sensor by means of a 
fish- eye objective lens having a constant field angle 
relative to its optical axis, the image sensor being 
rectangular in shape. 

10 The present invention also relates to a method for 

displaying an initial panoramic image captured in. accordance 
with the above-mentioned method on a screen. 

Figure 1 represents a classical device allowing a 
digital panoramic image * to be produced . and presented on a 

15 computer screen. The device comprises a digital camera 1 
equipped with a fish-eye objective lens 2 having a constant 
field angle relative to its optical axis and preferably 
offering a solid image capture angle of at least 2n 
steradians (i.e. a field angle of at least 18.0°). The camera 

20 1 is connected to " a. computer 5, such as a microcomputer f or 
example, equipped with a screen 6. The connection to the 
microcomputer 5 may be permanent, when, for example, the 
camera 1 is a digital video camera, or temporary, when, for 
example, the camera 1 is a still digital camera equipped with 

25 an image memory. 

Figure 2 schematically represents the appearance of a 
panoramic image 4 projected onto a digital image sensor 3 by 
means of the fish-eye objective lens 2. In accordance with 
the most widespread industrial standard for consumer digital 

30 cameras, the image sensor 3 is rectangular in shape, to 
produce rectangular photographs in 4/3 format (video format) . 
The image of the panorama projected onto the image sensor has 
the shape of a disk and is characteristic of the axial 
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symmetry of fish- eye objective lenses having a constant field 
angle relative to their optical axis. The entire image on the 
rectangular image sensor therefore has dark edges that will 
be removed when digitally processed subsequently. This 
5 rectangular digital image comprising the image disk 4 is 
delivered by the camera 1 in the form of a computer file 
containing image points coded RGBA arranged in a two- 
dimensional table, "R" being the red pixel of ah image point, 
"G" the green pixel, 11 B " the blue pixel, and "A" the Alpha 

10 parameter or transparency, the parameters R, G, B, A 
generally being coded on 8 bits. 

The image file is then transferred into the 
microcomputer 5 which transforms the initial image disk 4 
into a three-dimensional digital, image, then presents the 
.15 user with a sector of the three-dimensional image in a 
display window DW occupying all or part of the screen 6. 

Figure 3 schematically shows classical steps of 
transforming the two-dimensional panoramic image into a 
panoramic image offering a realistic perspective effect. 

20 After removing; the black edges of the image, the 
. microcomputer has a set of image points forming an image disk 
10 of centre O f and axes O'U and O'V. The image points of the 
image disk 10 are transferred into a three-dimensional space 
defined by ah orthogonal coordinate system of axes OXYZ, the: 

25 axis OZ being perpendicular to the plane of the intege disk. 
The transfer is performed by a mathematical function 
implemented by an algorithm executed by the microcomputer, 
and leads to obtaining a set of image points referenced in 
the coordinate system OXYZ . These image points are for 

30 example coded in spherical coordinates RGBA((p,9), q> being the 
- - lat itude and "9 "the "longitude "of" an "image point, the angles cp" 
and 0 being coded on 4 to 8 bytes (IEEE standard) . These 
image points form a sphere portion HS covering a solid angle 
of at least 2n steradians relative to the centre O of the 

35 system. The microcomputer therefore has a three-dimensional 
virtual image one sector 11 of which, corresponding to the 
display window DW mentioned above, is presented on the screen 
(Fig. 1) considering that the observer is on the central 
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point 0 of the system of axes OXYZ, which defines with the 
centre O" of the image sector 11, a direction 00" called 
"viewing direction" . 

This technique of displaying a digital panoramic image 
5 sector on a computer screen has various advantages, 
particularly the possibility of "exploring" the panoramic 
image by sliding the image sector 11 presented on the screen 
to the left, the right, upwards or downwards, until the 
limits of the panoramic image are reached. This technique 

10 also allows complete rotations to be carried out inside the 
image when two complementary digital images have been taken 
and supplied to the microcomputer, the latter thus 
reconstituting a complete panoramic sphere by assembling two 
hemispheres. Another advantage provided by presenting a 

15 panoramic image on screen is to enable the observer to make 
enlargements or zooms on parts of the image. The zooms are 
performed digitally, by shrinking the image sector displayed 
and expanding the distribution of the image points on the 
pixels of the screen. 

20 Despite these various, advantages, digital zooms have 

the disadvantage of .being limited by the resolution, of the 
image sensor, which is generally, much- lower than that of a 
classical photograph. Therefore, when the enlargement 
increases, the granulosity of the image appears as the limits 

25 of the resolution of the image sensor are being reached. 

To overcome this disadvantage, it is well known to 
proceed with pixel interpolations so as to delay the 
apparition of the blocks pf colour which betray the limits of 
the resolution of the sensor. However, this method only 

30 improves the appearance of the enlarged image sector and does 
not in any way increase the definition. Another obvious 
solution is to provide an image sensor with a high 
resolution, higher than the resolution required to present an 
image sector without enlargement, so that there is a 

35 remaining margin of. definition for zooms. However, this 
solution is expensive as the cost price of an image sensor 
rapidly rises with the number of pixels per unit of area. Yet 
another classical solution involves arranging the image 
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sensor in a plane in which the diameter of the image disk is 
equal to the length of the image sensor. Thus the entire 
surface of the image sensor is covered but the image 
projected is cut off at the top and the bottom widthwise of 
5 the image sensor. The disadvantage is, in this case, a 
reduction in the field of view. 

Therefore, one general object of the present invention 
is to improve the definition offered by digital enlargements 
concerning certain parts, of a digital panoramic image, 
10 without the need to increase the number of pixels per unit of 
area of an image sensor and without reducing the field of 
view. 

To achieve this object, the present invention is based 
on two premises: 

15 1) rectangular image sensors used in consumer digital 

cameras, particularly 4/3 .sensors, are not optimised for 
fish-eye image capture.. As it. was seen above in relation with 
Figure 2, the black edges on each side of the image disk 4 
occupy a substantial surface area and represent a significant 

20" number of wasted pixels, to the detriment of the definition 
and the quality of the digital zooms, 

.2) in many applications such as . video surveillance, 
videoconferencing, visio-conf erencing, the most interesting 
zone of a digital panoramic: image ..is generally , situated 

25 towards the centre of the image, along a horizontal line that 
crosses the image disk from left to right passing through its 
centre. In the field of leisure, most panoramic images also 
comprise parts that are less interesting than others, such as 
the parts representing the sky or a ceiling for example, as 

30 well as the ground, the most useful part generally being 
located in the vicinity of the centre of the image, along the 
above-mentioned horizontal line. 

On the basis of these premises, the idea of the present 
invention is to provide an expansion of the fish-eye image 

35 projected onto a rectangular image sensor, by providing and 
using a fish-eye objective lens according to the present 
invention that distorts the images by anamorphose and 
stretches them sideways without reducing the field of view. 
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Thus, this expansion is performed lengthwise of the image 
sensor, without expanding the image widthwise of the image 
sensor to avoid the image going beyond the sensitive surface 
area of the sensor. The central zone of the image along the 
5 above-mentioned horizontal line then covers a greater number 
of pixels of the image sensor than if it were not expanded, 
and has a better definition, which substantially improves the 
quality of digital zooms . 

According, to another aspect of the present invention, 

10 subsequent processing of the image is provided to correct the 
optical distortions of the objective lens while keeping the 
advantage of a better definition, and an image sector free 
from distortion is presented in a display window. 

More particularly, the present invention relates to a 

15 method for capturing a digital panoramic image, comprising a 
step of projecting a panorama onto an image sensor by means 
of a fish-eye objective lens having a constant field angle 
relative to its optical axis, the image sensor being 
rectangular in shape, in which the fish-eye objective lens is 

20 provided to project onto the image sensor, without reducing 
the field of view, a distorted panoramic image which is hot 
in the shape of a disk and which covers a number of pixels on 
the image sensor higher than the number of pixels that would 
be covered by a conventional image disk. 

25 According to one embodiment; the fish-eye objective 

lens . has an image point distribution function that varies 
according to axes perpendicular to the optical axis of the 
objective lens, and which has a minimum spreading rate of the 
image along a first axis perpendicular to the optical axis, 

30 and a maximum spreading rate of the image along at least a 
second axis perpendicular to the optical axis, such that the 
image projected onto the image sensor is expanded along the 
second axis. 

According to one embodiment, the first and the second 
35 axes of the objective lens are perpendicular and the image 
projected by the objective lens onto the image sensor is 
ellipsoidal in shape. 
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According to one embodiment, the image sensor is 
arranged relative to the first and second axes of the 
objective lens so that the major axis of the ellipsoidal 
image coincides with an effective length of the image sensor. 
5 According to one embodiment, the image sensor is 

arranged relative to the first and second axes of the 
objective lens so that the major axis of the ellipsoidal 
image coincides with a diagonal of the image sensor. 

According to one embodiment, the objective lens has a 

10 distribution, function that is not linear and that has a 
maximum divergence of at least ±10% compared to a linear 
distribution function, such that the projected image has at 
least one substantially expanded zone and at least one 
substantially compressed zone . 

15 According to one embodiment, . the., fish-eye objective 

lens comprises a combination of a group of lenses provided to 
capture a panoramic image according to a determined field 
angle, and of at least one cylindrical lens having an axis of 
revolution perpendicular to the optical" axis - of the obj ective 

20 lens . 

The present invention- also relates to a method for 
displaying on a screen an initial panoramic image captured in 
accordance with the method . -according to the present 
invention,, comprising a step of correcting the distortions of 
25 the initial image. 

According to one embodiment, the correction step 
comprises transforming the initial image into a corrected 
digital image in the shape of a disk, the diameter of the 
corrected image being chosen so that the corrected image 
30 comprises a number of image points higher than the number of 
pixels of the image sensor covered by the initial image. 

According to one embodiment, the initial image is 
ellipsoidal in shape and the corrected image has a diameter 
the size in number of pixels of which is at least equal to 
35 the size in number of pixels of the major axis of the initial 
ellipsoidal image . 

According to one embodiment, the method comprises a 
step of projecting onto the initial image, image points of an 
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image sector to be presented on the screen, allowing the 
colours of the image points of the image sector to be 
presented on the screen to be determined, the step of 
projecting the image points of the image sector onto the 
5 initial image being performed by means of a distribution 
function representative of the optical properties of the 
fish-eye objective lens, such that the. step of correcting the 
distortions of the initial image is implicit in the 
pro j ection step . 

10 According to one embodiment, the projection step 

comprises a first step of projecting the image points of the 
image sector onto a sphere portion, and a second step of 
projecting,. onto the initial image, the image points 
projected onto the sphere portion. 

15 The present invention also relates to a computer 

program product recorded on a medium and loadable into the 
memory of a digital computer, comprising; program codes 
executable by the computer, arranged to execute the steps of 
the display method according to the present invention.. . 

20 The present invention also relates to a fish-eye 

objective lens having a constant field angle relative to. its 
optical axis, comprising optical means for projecting the 
image of a panorama onto an image sensor, and optical means 
for projecting, without reducing the field of view, a 

25 distorted image that is not in the shape of a disk and which 
covers a number of pixels on an image sensor higher than the 
number of pixels that ' would be covered by a conventional 
image disk. 

According to one embodiment, the objective lens has an 
30 image point distribution function that varies according to 
axes perpendicular to the optical axis of the objective lens, 
and which has a minimum spreading rate of the image along a 
first axis perpendicular to the optical axis, and a maximum 
spreading rate of the image along at least a second axis 
35 perpendicular to the optical axis, such that an image 
delivered by the objective lens is expanded along the second 
axis. 



8 



According to one embodiment, the objective lens has a 
distribution function that is not linear and that has a 
maximum divergence of at least ±10% compared to a linear 
distribution function, such that an image delivered by the 
5 objective lens has at least one substantially expanded zone 
and at least one substantially compressed zone. 

According to one embodiment, the objective lens 
comprises a combination of a group of lenses provided to 
capture a panoramic image according to a determined field 
10 angle, and of at least one cylindrical lens having an axis of 
revolution perpendicular to the optical axis of the objective 
lens . 

, . According to one embodiment, the objective lens 
comprises optical means forming an apodizer. 
15 According to one embodiment , the optical means forming 

an apodizer comprise at least one a-spherical lens. 

According to one embodiment, the objective lens 
comprises at least one distorting mirror. 

According to' one embodiment, the objective lens is of 
20 the panoramic adapter type and is provided to be placed, in 
front of a still camera non-panoramic objective lens. 

These and other objects, features and advantages of the 
present invention shall be explained in greater detail in the 
following description of the method according to the present 
25 invention and of an example of an embodiment of a fish-eye 
objective lens according to the present invention, given in 
relation with, but not limited to the following figures: 

- Figure 1 described above represents a -classical system for 
displaying a digital panoramic image on a screen, 

30 - Figure 2 described above represents a fish- eye type 
panoramic image projected onto a rectangular image sensor, 

- Figure 3 described above shows a classical method for 
transforming a two-dimensional panoramic image into a three- 
dimensional digital panoramic image, 

35 - Figure 4 is a schematic cross -section of a panoramic image 
capture system comprising a fish-eye objective lens according 
to the present invention, 
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- Figures 5A, 5B, 5C represent optical properties of a fish- 
eye objective lens used to implement the image capture method 
according to the present invention, 

- Figure 6 represents a system for displaying a digital 
5 panoramic image, 

- Figures 7A and 7B show a first method for correcting a 
panoramic image according to the present invention, 

- Figure 8 is a flow chart describing a method for displaying 
a panoramic image incorporating the first correction method, 

Id - Figure 9 shows a second method for correcting a panoramic 

image according to the present invention, 

Figure 10 is a. flow, chart describing a method for 

displaying a panoramic image incorporating the second 

correction method, 
15 - Figure 11 shows by a cross-section an example of an 

embodiment of a fish-eye objective lens according to the 

present invention, 

- Figure 12 is ah exploded cross -section of a system of 
lenses present in. the objective lens. in Figure 11, 

20 — Figure 13 shows one alternative of the panoramic image 
capture method according to the present invention, and 

Figures 14A and 14B show . another alternative, of < the 
panoramic image capture method according to the present 
invention, and 

25 - Figures 15A and 15B show yet another alternative of the. 
panoramic image capture method according to the present 
invention. 

Description of a panoramic image capture method 
according to the present invention 
30 I - Distortion of an initial image 

Figure 4 schematically represents, by a cross -section, 
a panoramic image capture system comprising a fish-eye 
objective lens 15 according to the present invention having a 
constant field angle relative to its optical axis OZ, and a 
35 rectangular image sensor 16 arranged in the image plane of 
the objective lens 15. 

Seen in the planigraphic plane in Figure 4, the 
properties of the fish-eye objective lens 15 conform to those 
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of a classical objective lens and are characterised by a 
determined angular distribution function Fd. As an example 
two object points a, b will be considered belonging to a 
panorama PM and respectively having field angles al, a2 . 
5 Conventionally, the field angle of an object point is the 
angle that an incident light ray passing through the object 
point considered and through the centre of the panorama PM, 
marked by a point "p", has relative to the optical axis OZ. 
On the sensor 16, image points a f , b 1 corresponding to the 
10 object points a, b are located at distances d(a'), d(b f ) from 
the centre of the image that are linked, to the angles al, a2 
by the following relations: 

(1) d(a' ) = Fd (al) 
15 (2) d(b' ) = Fd (a2) 

Fd being the distribution function of the image points 
relative to the field angle of the object points. 

The objective. lens 15 according to the present 

20 invention differs from a. classical objective lens by the ■- fact 
that the distribution function Fd varies according to the 
position of the. object points, in a plane perpendicular to the 
optical axis OZ. This will be better ... understood with - 
reference to Figures 5A, 5B and 5C that show the properties 

25 of this objective lens. 

Figure 5A represents the panorama PM in the form of a 
circle, the optical axis OZ here being perpendicular to the 
plane of the Figure. The objective lens has two axes XI, X2 
located in a plane PL perpendicular to the optical axis OZ 

30 (i.e. parallel or merged with the plane of the sheet), each 
of the two axes XI, X2 passing through the optical axis OZ . 
The angular deviation between the two axes XI, X2 is 
designated \|/1 and is preferably equal to 90°. According to 
the present invention, the objective lens has a distribution 

35 function Fd[Xl] along the axis XI and a distribution function 
Fd[X2] along the axis X2 . The functions Fd[Xl] and Fd[X2] are 
different, the function Fd[Xl] being the one that has a lower 



spreading rate of the image and the function Fd[X2] the one 
that has a higher spreading rate of the image. 

For a better understanding, two pairs of object points 
al, bl and a2 , b2 will be considered respectively arranged 
5 along the axis XI and the axis X2, the points al and a2 
having the same field angle al and the points bl and b2 the 
same field angle a2 relative to the optical axis OZ (Cf. 
Figure 4) . Figure 5B represents the projection of these 
points onto the rectangular image sensor 16. The objective 

10 lens is arranged relative to the image sensor 16 so that the 
axis with the lower spreading XI coincides with the width of 
the sensor and the axis with the higher spreading X2 
coincides with the length of. the sensor. The axis X2 
preferably corresponds to the horizontal axis of a shot taken 

15 and the axis XI corresponds to the vertical axis. On the 
projected image, represented in Fig. SB, image points al 1 , 
bl' along the. axis XI and image points a2 1 , b2 1 along the 
axis X2 can be distinguished. The point al 1 is at a distance 
d(al') = F[Xl](al) from the centre of the image, the point 

20. bl 1 is. at a distance d(bl f ) = F[Xl](cc2) from the centre of 
- the image, the point a2 ' is at a distance d(a2') = F[X2] (al) 
from the centre of the image and the point b2 1 is: at a 
distance d(b2\) = F[X2] (a2) from the centre of the image; 
With a classical fish-eye objective lens, the distance d(a2' ) 

25. would be equal to the distance d(al f ) as the object points 
al, a2 have the . same field angle al. Similarly, the distance 
d(b2') would be equal to the distance d(bl') as the object 
points bl, b2 have the same field angle a2 . With the fish- 
eye objective lens according to the present invention, the 

30 distance d(b2') is greater than the distance d(bl f ) and the 
distance d(a2') is greater than the distance d(al'). 

Preferably, the function Fd[Xl] is chosen so that the 
image points present along the axis XI occupy the whole 
effective width lc of the sensor. Similarly, the function 

35 Fd[X2] is chosen so that the image points present along the 
axis X2 occupy the whole effective length Lc of the sensor. 
Thus, if the field angles of the object points bl, b2 are 
equal to 90°, as represented in Figures 4 and 5A, and if the 
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angular aperture of the objective lens is 180° , the distances 
d(bl ! ), d(b2') relative to the centre of the image of the 
image points bl 1 , b2 1 are respectively equal to lc/2 and Lc/2 
(Fig. 5B) . 

5 In addition to the axes XI and X2, the obj ective lens 

according to the present invention has an infinity of 
intermediate axes Xi along which the objective lens has 
distribution functions Fd[Xi] having a determined spreading 
rate higher than the minimum spreading rate . As an example , 

10 an axis Xi that has an angle \j/i relative . to the axis XI, 
with yi lower, than \j/l, and two object points ai, bi situated 
along the axis Xi and having field angles al, a2 (Fig. 5A) 
will be considered. The corresponding image points ai ' , bi 1 
on the sensor 16 (Fig. 5B) are located at distances 

15 dial 1 )..- F[Xi] (al) and d(bi') = F[Xi] (a2) relative to the 
centre of the image. The distances d(ai') and d(bi') are 
respectively greater than d(al') and d(bl') 

Therefore, the distribution function Fd of a. fish-eye 
objective lens according, to the present . invention varies 

20 according to the axis along which the object points are 
. located/ in a plane perpendicular to the optical axis OZ, and 
has a minimum spreading rate along the axis XI and a maximum 
spreading rate along at least a second/ axis, i.e. the axis X2 
in the example described above. 

25 . Below in relation with Figures 11 and 12 an embodiment 

of an objective Tens according to the present invention will 
be described which delivers an ellipsoidal image, by using a 
toroidal lens having an axis of revolution parallel to the 
optical axis, equivalent to a cylindrical lens having an axis 

30 of revolution perpendicular to the optical axis. On Figure 
5B, the image point ai 1 is then located on an ellipse passing 
through the points al 1 and a2 1 and the image point bi 1 is 
located on an ellipse passing through the points bl 1 and b2 1 . 
Moreover, again according to the embodiment described 

35 below in relation with Figures 11 and 12/ the function Fd is 
linear along each axis Xi of the objective lens, such that 
the distance d(ai ! ) in relation to the centre of the image of 
an image point ai • obeys the following relation: 
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(3) d(ai') = Ki ai 

in which ai is the field angle of the corresponding object 
5 point ai, and Ki a distribution constant which varies 
according to the axis Xi along which the object point is 
located. 

For a better understanding, examples of distribution 
functions Fd[Xi] of an objective lens according to the 

10 present invention are represented in curve form in Figure 5C, 
on a graph comprising relative distances dr on the Y-axis and 
field angles a on the X-axis. The relative distance dr of an 
image, point is the distance of the image point in relation to 
the centre of the image divided by the greatest distance 

15 relative to the centre of the image of an image point 
situated on the axis XI. In the case of an ellipsoidal image, 
this greatest distance along the axis XI is the half-length 
Dl/2 of the minor axis of the ellipsoid. 

On Figure 5C. three curves can be distinguished that 

20 correspond to the three distribution functions Fd[Xl], 
Fd[X2], Fd[Xi] ..In this example, these distribution functions 
are linear and are thus in the form of straight lines, of 
respective gradients KI, K2 and Ki. The gradient KI is equal 
to 1/90° for an objective lens having an angular aperture of 

25 180°, the gradient K2 is greater than KI and the gradient Ki 
is between KI and K2 . As indicated above, the gradient K2 is 
preferably equal to Kl*Lc/lc so that the image covers the 
whole effective length Lc of the image sensor. 

In the description below, the other aspects of the 

30 present invention will be described considering the case of a 
projection of an ellipsoidal image onto the image sensor. 
This ellipsoidal image will be designated an "image 
ellipsoid" while the classical image in the shape of a disk 
will be called an "image disk", in accordance with the usual 

35 terminology. 

The advantage of the method according to the present 
invention is that the surface covered by the projected image 
is greater than the one covered by an image disk, without 
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reducing the field of view, such that the number of pixels 
covered by the image is higher. The gain in definition 
obtained using the present invention, expressed in a ratio of 
pixels, is easy to calculate in the case of an ellipsoidal 
image. On the surface area of the image sensor, the image 
ellipsoid covers a number of pixels NP equal to: 

(4) NP = 7i(Dl/2) * (D2/2) *Np 

Np being the number of pixels of the sensor per unit of area, 
D2 being the major axis and Dl the minor axis of the 
ellipsoidal image (it shall be noted here that Dl is imposed 
by the effective width lc of the sensor and that D2 can, at 
the most, be equal to the effective length Lc of the sensor). 

In comparison, the number of pixels NP ! covered by an 
image disk is : 

■ (5) NP' = tc(D1 2 /4) *Np 

Dl being the diameter of the image,; imposed by the width of 
the sensor. 

By combining the relations (4) and (5,),, Jthe percentage 
G% of pixels gained between an image ellipsoid and an image 
disk is equal to: 

(6) G% = (D1/D2 - 1) *100 

The number of pixels that image sensors of consumer 
digital cameras currently comprise is in the order of 2 
million pixels, i.e. 1600x1200 pixels, the 4/3 ratio 
corresponding to the standard of the consumer digital 
photography market. An objective lens according to the 
present invention performing an ellipsoidal projection 
offers, in these conditions, a 33% gain in number of pixels 
covered, which represents a significant gain in definition 
along the axis X2 and in the parts of the image located in 
the vicinity of the axis X2 . 
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This gain is even higher when the method according to 
the present invention is implemented with a conventional 
camera using a film having a length to width ratio of 3/2 
(format 24*3 6 of commercial films) . The photograph taken is 
then digitised with a scanner having a determined definition. 
After digitisation, the gain in number of pixels covered (at 
constant definition during the digitisation) is then of 50%. 

It will thus be noted here that the method according to 
the present invention is applicable both to. digital 
photography techniques using digital image sensors and to 
digital photography techniques comprising a step of taking a 
conventional photograph followed by a step of digitising the 
photograph by means of a scanner. Therefore, in the present 
application, the term "digital image sensor" designates both 
a digital image sensor and a conventional photographic film 
combined with a digitisation device such as a scanner. 

II - Correction of the distortions of the initial image 

A first aspect of the present invention was described 
above, according to which ah expansion of. an image pro j ected 
onto an .image sensor was provided in order to improve the 
definition of the image in expanded zones, by increasing the 
number of pixels of the image sensor covered. by, the- expanded 
zones. Before describing an example of an embodiment of a 
fish-eye objective lens according to the present invention, a 
second aspect of the present invention will be described 
which involves correcting the distortions of the' initial 
image so as to present the observer with an image free from 
optical distortion. As indicated above, the description of 
this aspect of the present invention will be given with 
reference to an image ellipsoid. 

This second aspect of the present invention is 
implemented at the stage of the processing of the initial 
image by computer, to present an interactive panoramic image 
on a screen. The means for implementing the method of the 
present invention are shown in Figure 6 and are classical per 
se as far as their general arrangement is concerned. A 
digital camera 2 0 can be distinguished equipped with a fish- 
eye objective lens 21, here an objective lens according to 
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the present invention, connected to a microcomputer 22 
comprising a screen 23 . Digital images IMi taken by means of 
the camera 2 0 are transferred to the microcomputer to be 
processed and displayed on the screen 23, in a display window 
DW. A processing program according to the present invention, 
comprising an algorithm for transforming and displaying the 
images is first loaded into the microcomputer, by means of a 
CD-ROM 25 or by downloading via the Internet for example. The 
camera 20 can be a still digital camera or a digital video 
camera and . the connection to the microcomputer can be 
permanent .or otherwise. In the case of a video camera, the 
microcomputer receives a flow of images that it processes in 
real time to display them on the screen. 

In this context, the present invention provides two 
ways of correcting the distortions of the initial image. 
According to a first embodiment, the. image ellipsoid is 
corrected so as to obtain a classical image disk. The 
corrected image disk is equivalent to an image disk produced 
by a classical fish-eye -objective .lens and can then be 
processed by any classical display sqftWa.re program available 
in stores, provided for transferring the image points of an 
image disk into a .three-dimensional space and for 
interactively . displaying a sector of the three -dimensionaX 
image on a screen. According to a second embodiment, the 
image is corrected in real time at the time the image points 
constituting the image sector to be presented in the display 
window DW are determined, by using the angular distribution 
function Fd of the objective lens. 

First embodiment of the correction method 

Figures 7 A and 7B show the first embodiment of the 
method according to the present invention. Here it is assumed 
that there is an initial . image Imgl comprising an image 
ellipsoid ID1 of minor axis Dl and of major axis D2 (Fig. 
7A) . The initial image Imgl is transformed into a corrected 
image Img2 comprising an image disk ID2 of radius D3 (Fig. 
7B) . The radius D3 of the image disk ID2 is preferably equal 
to the major axis D2 of the image ellipsoid ID1, such that 
the image disk ID2 has a resolution equal or substantially 
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equal to the resolution offered by the most stretched out 
zone of the image ellipsoid ID1, where the greatest density 
of information is to be found. Here it is the central part of 
the image located in the vicinity of the major, axis D2 . 
5 This method therefore involves stretching the image 

vertically in a proportion of (D2/D1) *100 percent. It can be 
implemented by means of the algorithm 1 described below as an 
example, in which: . 

- Imgl is the initial image comprising the image ellipsoid 
10 ID1, 

- Img2 is the image generated by algorithm 1, comprising a 
classical image disk ID2, 

- a is the half-length of the minor axis of the . image 
ellipsoid ID1, expressed in number of pixels, i.e. 

15 a = Dl/2*Npl, Npl being the number of pixels per unit of 
length of the image sensor used, 

- b is the half-length of the major axis of. the image 
ellipsoid ID1, expressed., in number of pixels, i.e. 
b = D2/2*Npl, 

20 - b is also the radius of the image disk ID2 , expressed in 
number of pixels, 

- "O" designates the centre of the initial image Imgl as well 
as the centre of the image generated Img2, 

- i and j are the coordinates of an image point Img2[i,j] in 
25 the 'image Img2, i designating the columns, j the lines > the 

coordinate point (0,0) being in the centre of the image, 

- r is the distance in relation to the centre of the image of 
an image point in the image Img2 , 

- "u ,f and "v" are the coordinates of an image point Imgl[u,v] 
30 in the initial image Imgl, "u" designating the columns, "v" 

the lines, the coordinate point (0,0) being in the centre of 
the image , 

- [OU) is a reference axis of direction U having its origin 
in O, 

35 - [OP] is a straight line segment having a point of origin in 
0 and an end point in P, P being an image point of 
coordinates (u,v) , 

- 0 is an angle between the axis [OU) and a segment [OP] , 
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"V" is the square root function. 

"arc cos" is the inverse function of the cosine function. 
ALGORITHM 1 



1/ For i = -b to +b 

5 2/ For j = -b to +b 

3/ r = /(i*i+j*j) 

4/ If (r < b) then 

5/ If j<0 then 

6/ 0 = arc cos(i/r) 

10 7/ If not 

8/ 0 = -arc cos(i/r) 

9/ End if 

10/ u = r*cos(0) 

11/ v = (a/b) *r*sin(e)~ 

15 12/ Img2[i / j] = Imgl[u,v] 

13/ End if 

14/ End for 



15/ End for - . 

In practice, the algorithm 1 can be improved by 

20 subsequently performing a bilinear interpolation on the image 
Img2, in itself well known by those skilled in the art, so as. 
to smpoth out the final image. 

Figure 8 is a flow chart giving a general overview of 
the steps of. a method for capturing and interactively 

25 presenting a panoramic image on a screen. This flow chart is 
described in table 1 in the Appendix, that is an integral 
part of the description. The steps SI and S2, respectively 
the acquisition of the image and the transfer of the image 
into a computer, are classical in themselves and differ from 

30 previous practices by the fact that the captured image is 
ellipsoidal in shape. The step S3 of correcting the image 
ellipsoid ID1 is executed in accordance with the method of 
the present invention, by means of the algorithm described 
above for example. The step S4, called "digitisation", is 

35 also classical. This step involves transferring the image 
points of the image disk ID2 into a three-dimensional space 
of axes OXYZ in which the image points are for example 
referenced in spherical coordinates. The step S5 is also 
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classical and involves presenting a sector of the image in 
the display window DW. The display window is moved upwards or 
downwards depending on the user's actions, or is enlarged at 
the user's request. When enlarged, the definition is better 
5 than in previous practices in the zones corresponding to the 
expanded parts of the initial image . 

Second embodiment of the correction method 
The second embodiment of the correction method 
according to the present invention is shown in Figure 9 . Very 

10 schematically, this method involves projecting the image 
points of an image sector IS to be presented in the display 
window DW (Fig. 6) onto the image ellipsoid ID1 of the 
initial image Imgl . This method does not require calculating 
a corrected image disk. 

15 The image points of the image sector IS to be displayed 

in the window DW are referenced E(i,j) in the coordinate 
system of the image sector IS, that is expressed in line 
coordinates i and in column coordinates j. The points E(i,j) 
are first projected onto a sphere portion HS of centre 0 and 

20 of radius R in, a coordinate system of origin O and of axes 
OX, OY, OZ, to pbtain image points P(px,py,pz) belonging to 
the sphere portion. - . 

.Out of . concern to remain simple, it will be considered 
that the fish-eye objective lens that is used here has an 

25 angular aperture of 180°. The sphere portion HS is .in this 
case a hemisphere. The image sector IS moves tangentially to 
this hemisphere. 

The image points P(px,py,pz) determined on the 
hemisphere HS are then projected onto the image ellipsoid ID1 

30 by means of the distribution function Fd of the fish-eye 
objective lens, which first requires calculating the field 
angle a of the points P in relation to the centre O of the 
hemisphere, the centre O being the virtual equivalent of the 
centre "p" of the panorama at the time the image is captured. 

35 The projection of the image points P(px,py,pz) onto the 
hemisphere HS allows image points P' (pu,pv) to be obtained on 
the image ellipsoid, in a coordinate system of centre O f 
corresponding to the centre of the image ellipsoid and of 
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axes O f U and O f V. The axis OZ in the system of the hemisphere 
is perpendicular to the plane of the image ellipsoid ID1 and 
passes through the centre O', such that the axes O'Z and OZ 
are merged. 

5 As it will be clear to those skilled in the art, the 

correction of the distortions of the image is implicit here 
since the image points P' (pu,pv) corresponding to the image 
points E(i, j) of the image sector IS are "retrieved" from 
the image ellipsoid. ID1, by means of the distribution 
10 function Fd. 

The method . according to the present . invention is 
implemented by means of the algorithm 2 described below, in 
which: 

i and j are the coordinates of a point E(i, j) of the image 
15 sector IS, 

- Imax and Jmax are the number of columns and the number of 
lines of the image sector IS, 

- Ex, Ey and Ez are the Cartesian coordinates of a point 
E(i,j) of the image sector IS in the coordinate system OX YZ, 

20 - px, py and pz are the Cartesian coordinates of a point 
P(px,py,pz) on the hemisphere HS, 

- pu and py are , the Cartesian coordinates of an image point 
P' (pu,pv) of the image ellipsoid in the coordinate system 
O'UV, - 

25 . LI is the size of the half minor axis of the image 
ellipsoid, expressed in number of pixels (LI = Dl/2*Npl) , 

- L2 is the size of the half major axis of the image 
ellipsoid, in number of pixels (LI = D2/2*Npl) , 

- M is the centre of the image sector IS, 

30 - the "viewing direction" is the direction materialised by 
the point O and the centre M of the image sector IS, the 
image sector forming the base of a pyramid of vision of the 
observer the top of which is the point O (observer's 
position) , 

35 - 90 and (p0 are the longitude and latitude of the viewing 
direction, 

- Screen_Pixel [i, j ] is the colour (RGBA) of a point E (i,j) 
of the image sector IS, 
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- Image_Pixel [pu,pv] is the colour of a point P' (pu,pv) of 
the image ellipsoid ID1, 

- R is the radius of the hemisphere HS used as reference for 
the tangential sliding of the image sector IS, R having an 

5 arbitrary value chosen so as to improve the accuracy of the 
calculations, such as 10,000 for example, 

- a is the angle in relation to the centre O of an image 
point P(px,py,pz) (represents the field angle at the time the 
shot is taken of the corresponding object point) , 

10 - auxl, aux2 are intermediate variables, 

- "Zocm" is a variable defining the enlargement, having a 
default value equal to R, and 

- "V" is the. square root function. 

ALGORITHM 2 

15 1/ For i=-Imax/2 to i=Imax/2 do [by increments of 1] 

2/ For j=-Jmax/2 to j=Jmax/2 do [by increments of 1] 
[calculation of the Cartesian coordinates Ex, Ey, Ez of the 
point E of the image sector in the coordinate system (OXYZ) ] 
3/ Ey = j*cos((p0) - Zoom*sin((p0) 

20 4/ Ez = Zoom*cos (<p0) + j*sin(cp0) 

5/ . auxl = Ez . 

6/ Ez = Ez*cos (00) - i*sin(0O) 

7/ Ex = i*cds (00) .+ auxl*sin(0O) . 

/"calculation of the coordinates of a point P corresponding to 
25 the point E] 

8/ aux2. = R/V(Ex*Ex + Ey*Ey + Ez*Ez) 

9/ px = Ex*aux2 

10/ py = Ey*aux2 

11/ pz = Ez*aux2 

30 [calculation of the coordinates of a point P' (pu,pv) 

corresponding to the point P (px,py,pz) ] 

12/ X = px/R 

13/ Y = py/R 

14/ r = V(X*X + Y*Y) 

35 15/ d = arc sine(r) [angle in relation to the centre] 

16/ U = X/r 

17/ V = Y/r 

18/ pu = Ll*U*Fd(a) 
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19/ pv = L2*V*Fd(a) 

[allocation of the colour of the point P' (pu,pv) to the point 
E(i,j) of the image sector] 

20/ Screen_Pixel [i, j ] = Image_Pixel [pu, pv] 

5 21/ end for 
22/ end for 

It will be noted that the function Fd used here in 
steps 18 and 19 is not a function Fd[Xi] that depends on the 
axis Xi considered but is the function Fd[Xl] along the axis 

10 XI. Indeed, the choice has been made here to simplify the 
algorithm so as not to take into account the angle which 
is made possible by the ellipsoidal shape of the image ID1 . 
The adaptation .of the steps 18 and 19 to the ellipsoidal 
shape of the image is ensured by the parameters LI and L2 . If 

15 the : function Fd[Xl] is linear, -each value of Fd(a) is 
calculable during the steps 18 and 19 by means of the 
following relation: 

Fd(a) = Fd[Xl] (a) = Kl*a 
20 .* with Kl = 2k/ a 

, A request for enlargement (zoom) by the user results in 
the algorithm modifying the "Zoom" parameter. When the "Zoom" 
parameter is equal to the radius R of the hemisphere, no zoom 
.25 is performed. When the "Zoom" .parameter is- higher than R, the 
window DW moves away from the hemisphere HS (along the axis 
given by the viewing direction 0M), -which corresponds to a 
shrinking of the pyramid of vision and thus an enlargement of 
the image sector presented in the window DW. The enlargement 

30 of the image sector presented to the observer is therefore 
equal to the ratio of the "Zoom" and R parameters. 

When the algorithm is executed with a "Zoom" parameter 
higher than R, a gain in definition is obtained in the zones 
in which the image has been expanded at the time the shot is 

35 taken as there are still, while the resolution limit is not 
reached, two image points on the image ellipsoid ID1 which 
correspond to two adjacent pixels of the image sector. In the 
non-expanded zones of the image, the search for the closest 
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pixel by means of the relations Ll*U*Fd(a) and L2*V*Fd(<x) 
results, on the other hand, in the algorithm finding the same 
image point for several adjacent pixels of the image sector 
IS on the image ellipsoid ID1. However, these non-expanded 
5 image zones benefiting from a lesser definition on the image 
ellipsoid, equivalent to that obtained with a classical fish- 
eye objective lens, are considered secondary for the intended 
application, in accordance with the premise on which the 
present invention is based. 

10 Generally speaking, it will be clear to those skilled, 

in the art that other projection methods can be provided, it 
being essential to find the field angle a of the object 
points on the hemisphere HS, in relation to the centre O, so 
as to use the distribution function Fd in the calculations. 

15 It will be understood that the algorithm - 2 is 

applicable when there are two complementary image ellipsoids, 
one corresponding to a front photograph and the other to a 
rear photograph of a panorama, the. second photograph being 
taken by rotating the fish-eye objective lens -according, to 

20 the present invention by 18 0° around an axis; passing through 
. the centre of the panorama. In this case, two complementary 
hemispheres and two image points, called "Front_Image_Pix;el n 
and " Rear_Image_Pixel " are defined.. The steps 18 and 
. following of the algorithm are thus modified as follows: 



25 18 


»/ pu = Ll*U*Fd(d) 






19 


/ pv = L2*V*Fd(a) 






20 


/ If pz >= 0 then 






21 


/ Screen_Pixel [ i , 


j] 


= Front_Image_Pixel [pu, pv] 


22 


/ If not 
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/ Screen_Pixel [ i , 


j] 


= Rear_Image_Pixel [Ll-pu, pv] 


24 


/ End if 






25 


/ end for 






26 


/end for 







Figure 10 is a flow chart . giving a general overview of 
35 the steps of a method for capturing and interactively 
presenting a panoramic image on a screen. This flow chart is 
described in table 2 in the Appendix, that is an integral 
part of the description. The acquisition SI and transfer S2 
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steps described above are again included. The step S2 is 
followed by an interactive display step S3 ' performed in 
accordance with the method that has just been described, 
implicitly incorporating a correction of the distortions of 
5 the image ellipsoid through the use of the distribution 
function Fd of the objective lens to find the points 
corresponding to the pixels of the image sector on the image 
ellipsoid. 

Ill - Example of an embodiment of a fish-eye objective 
10 lens according to the present invention 

The design of an ellipsoidal projection fish-eye 
objective lens is based here on the use of cylindrical 
lenses. This type of lens is already known per se and used in 
cinema to obtain lenses of cinemascope format. This type of 
15 lens is also used in compact disk players to position the 
laser beam on the surface of a compact disk with great 
precision. 

As part of the present invention, cylindrical lenses 
(also called toroidal lenses when the radius of curvature is 

20 infinite) are used' to increase the . resolution lengthwise of 
the image sensor, in combination with lenses performing^ fish- 
eye type, image capture. The intended technical effect can be 
obtained using one or more cylindrical lenses placed at one 
end of a; group of lenses equivalent to a fish-eye objective 

25 lens,- the image being stretched along the perpendicular of. 
the axis of the cylinder. 

One particular embodiment of an objective lens 
according to the present invention is described below as an 
example without limitation. 

30 Figure 11 is a cross-section of a fish-eye objective 

lens 3 0 according to the present invention. The objective 
lens 3 0 is here of the panoramic adapter type ( "pano- 
converter") and is designed to be mounted onto the front lens 
of a still camera. It also relates to consumer cameras of the 

35 non-SLR (non Reflex) type comprising a 35mm fixed objective 
lens . 

The objective lens 3 0 comprises, in the direction from 
the input of the light rays (left of the Figure) towards the 
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output of the light rays, eight lenses LI to L8 . The lens LI 
is an a- spherical lens in acrylic of divergent meniscus type, 
the front of which is convex and the back concave. The lens 
L2 is a spherical lens in acrylic of convergent meniscus 
5 type, the front of which is concave and the back convex. The 
lens L3 is an a- spherical lens in acrylic of biconvex type. 
The lens L4 is an a-spherical and diffractive lens (asphero- 
dif tractive) of convergent meniscus type the front of which 
is convex and the back concave, the back comprising a 

10 diffraction grating. The lens L5 is an a-spherical lens in 
acrylic of the convergent meniscus type, the front of which 
is concave and the back convex. The lens L6 is a plano-convex 
spherical lens in BK7 (borosilicate or standard mineral glass 
used in optics) , the front of which is convex. 

15 According to the present invention, the lenses L7 and* 

L8 are cylindrical lenses having an axis of revolution 
perpendicular to the optical axis. To thb£e skilled in the 
art, these lenses are the. equivalent of a torus portion of 
inf inite radius having , an axis of revolution parallel to the 

20 optical axis. The lens L7. is a planoconcave cylindrical lens 
in BK7 the back of which is concave (the concavity is not 
?hown. on Figure 11 due to its v low value.) ..- The lens L8 is a 
cylindrical lens of planoconvex type in BK7, having its front 
convex (same remark) . 

25 Very schematically, the lens LI allows a panoramic 

image to be captured according to a desired field angle, here 
a field angle of 185°. The back of the. lens L2 corresponds to 
a pupil, and forms the main diaphragm of the optical system. 
The lens L4 is a field lens which contributes to the 

30 pupillary imaging. The diffractive surface that this lens 
has, in addition to its dioptric function, causes a phase 
shift of the light wave complying with a polynomial law of 
the radius of aperture. The lenses L8 and L7 perform the 
ellipsoidal distortion sought. The other lenses have no 

35 special role, but they contribute to obtaining the final 
result and to the overall performances of the objective lens 
according to the present invention. 
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A detailed embodiment of the panoramic adapter lens 3 0 
is described by the table 3 in the Appendix, that is an 
integral part of the description. The table 3 describes the 
properties of each surface with reference to Figure 12, which 
5 is an exploded view of the lens system. On this Figure, the 
front and back of the lens LI are referenced Sll and S12, the 
front and back of the lens L2 are referenced S21 and S22, the 
front and back of the lens L3 are referenced S31 and S3 2, 
etc., the front and back of the lens L8 being referenced S81 
10 and S82 . 

The a- spherical surfaces are determined by means of a 
surface equation of the type: 

z(r) = [(C*r 2 )/(1 + ^(l- (l+k) *C ? *r 2 ) ] + A x r 2 + A;>r 4 + A 3 r 6 + 
15 A 4 r 8 + A 5 r 10 " » . 

in which.: 

l! k M is a conicity constant, 

"Al", "A2", "A3", "A4", "A5" are constants for adjusting the 
coefficient of conicity according to the position, 

20 "z" is the shape of the surface, 

"r" is the radius at the centre, and 
"C" is the radius of curvature. 

The thickness and the diameters are expressed in 
millimetres. Conicity is a dimensio.nless quantity, a conicity 

25. of "0" designating a circle of revolution, a conicity of " -1" 
designating a parabola of revolution, a conicity between "-1" 
and designating an ellipse of revolution, a. conicity 

lower than -1 or greater than +1 designating a hyperbola of 
revolution, the coefficients Ai in the surface equation 

30 allowing the general shape to be adjusted. 

The diffractive side of the lens L4 is determined by 
means of a formula of the type : 

<D(r) = pi (r/RO) 2 + 02 (r/RO) 4 

35 

in which: 

"r" is the distance in relation to the centre of the lens of 
a point considered, located on the surface of the lens, 
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Pi and p2 are constants defining the phase shift of the wave 
surface, 

"RO" is a constant allowing r to be normalized, and 

"9" is the phase shift introduced by the diffractive surface 

5 at the point considered. 

It will be clear to those skilled in the art that the 
combination of lenses that has just been described is only 
one example of an embodiment allowing a shape close to the 
rectangular shape of the image sensor to be obtained. 

10 Objective lenses could also be provided using toric lenses or 
bi-toric lenses more complex in shape, such as a torus with 
a- spherical surface for example. In one alternative 
embodiment, an objective lens according to the present 
invention c;an be produced by means of an indirect-type 

15. optical system, tha.t is using' mirrors. .In particular, a 
mirror of. cylindrical or toroidal surface can be used to 
distort and spread the image on the surface of the image 
sensor. 

IV - Scope of the present invention - alternative 
20 embodiments 

The description above was of a method for capturing a 
panoramic, image by means of a fish- eye objective lens and a 
digital image sensor rectangular in shape, in which the 
objective lens is designed to distort the panoramic image so 

25 as to qover a greater number of pixels on the image sensor 
without reducing the field of view. A method for displaying 
on a screen a sector of a panoramic image obtained according 
to this method was also described, comprising a step of 
correcting the distorted panoramic image. This correction 

30 step can comprise the correction of the image before 
transferring it into a three-dimensional space, leading to 
obtaining a classical image disk. The correction can also be 
implicit and be performed at the time an image sector to be 
presented on the screen is projected onto the non-corrected 

35 initial image, by using the distribution function of the 
objective lens or a similar mathematical function. 

It will be clear to those skilled in the art that 
various alternatives of the present invention may be made 
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relating to both the optical properties of the fish-eye 
objective lens used or its arrangement relative to the image 
sensor, and in the steps of subsequently processing the 
panoramic image obtained. Various applications of the present 
5 invention . are also possible. In addition to applications to 
photography and to video, the present invention is 
particularly applicable to medicine, in endoscopy for 
example, in which rectangular image sensors are generally 
used. The field angles of the lenses used in these 
10 applications are generally lower than 18 0° and rather in the 
order of 140° . 

Alternative relating to the relative arrangement of the 
image sensor and the axes XI and X2 of the objective lens 

Figure 13 represents an alternative embodiment of the 
15 method according to the present invention in which the 
objective lens and the image sensor are arranged relative to 
each other.- so that the axis X2 (axis of greater spreading) 
coincides with a diagonal of the image sensor 16.. This 
embodiment allows a greater number of pixels of the image 
20 7 sensor to be covered along the axis X2 . Here, the obj Active 
lens has, along the axis XI (axis of lower spreading) , a 
.distribution function F[X1] ..that, compresses the image 
relative to a classical fish-eye objective lens. This 
embodiment amounts to giving maximum priority to the 
25 definition of the image along the axis X2/;i Which in practice 
can correspond to the horizontal axis of a shot. 

Alternative comprising providing a non-linear fish-eye 
objective lens 

In one advantageous alternative of the method according 
30 to the present invention, an objective lens is provided that 
further has non- linear distribution functions Fd' [Xi] along 
its axes Xi . For a better understanding, Figures 14A and 14B 
show the properties of an elliptic projection non- linear 
fish-eye objective lens. Figure 14A is a graph comprising the 
35 relative distance dr of an image point (relative distance in 
relation to the centre of the image) on the Y-axis and the 
field angle a of the corresponding object point on the X- 
axis. On this graph, the two most significant distribution 
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functions of the objective lens are represented, that is the 
functions Fd' [XI] and Fd' [X2] along the axes XI and X2 , and a 
distribution function Fd' [Xi] along any axis Xi. The linear 
functions Fd[Xl], Fd[X2], Fd[Xi] described above in relation 
with Figure 5C are represented in dotted lines as points of 
comparison. 

For field angles lower than an angle al, the functions 
Fd' [XI] , Fd' [X2] , Fd' [Xi] each have a gradient higher than 
the gradient Kl> K2 , Ki of the corresponding linear function 
Fd[Xl], Fd[X2] , Fd[Xi] . That means that the image points 
corresponding to object points having a field angle between 0 
and al are projected onto the image sensor with a spreading 
rate higher than the constants Kl, K2, Ki and are therefore 
further apart from each other. For field angles higher than 
the angle al, the functions Fd' [XI] , Fd' [X2] , Fd' [Xi] each 
have a gradient lower than the gradient Kl, K2> Ki of the 
corresponding linear function Fd[Xl], Fd[X2], Fd[Xi]. That 
means that the image points corresponding to object points 
having a field angle between al and A/2 (A being the angular 
aperture of the objective lens) are closer to each other. 

An image ellipsoid ID3 obtained with' this non- linear 
objective lens is, represented in. Figure 14B . The image 
ellipsoid, has a central ellipsoidal zone ID3-1 in which the 
image is expanded, and a peripheral zone ID3-2 in which the 
image is compressed. Thus a combination of two technical 
effects is obtained. The first technical effect is the 
increase in definition due to the spreading of the image 
along the axis X2 . The second technical effect is a further 
increase in definition in the central zone ID3-1 of the 
image, to the detriment of the compressed zone ID3-2 that is 
considered less important. The expanded zone benefits from a 
high definition as it covers a greater number of pixels on 
the image sensor, while the definition of the compressed zone 
is lower. 

In practice, a maximum divergence of at least ±10% 
compared to a linear distribution function is necessary to 
obtain an image expansion that is substantially advantageous 
when a digital zoom is made. "Divergence" means the 
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difference in percentage between the distance in relation to 
the centre of an image point and the distance in relation to 
the centre that would be obtained for the same image point if 
the distribution function were linear. The maximum divergence 
5 is the divergence measured at a point at which the non-linear 
function is the furthest away from the corresponding linear 
function. If the curve Fd' [X2] on Figure 14A is considered as 
an example, it can be seen that there is an image point pmax 
at which the curve Fd' [X2] is the furthest away from the 
10 linear curve Fd[X2]. By designating by drmax the relative 
distance of the point pmax and by drlin. the relative distance 
that this point would have in relation to the centre of the 
image if the distribution function were linear, the maximum 
divergence is here equal to: 

15 

DIVmax% = [ [drmax - drlln] / [drlin] ]* 100 

In practice, producing an objective lens' having non- 
linear .distribution functipns Fd' [XI]., Fd' [X2i] ; Fd' [Xi] - is 

20 within the understanding s of those skilled in" the art by 
adding a group of lenses forming an apodizer in an objective 
lens . according to the present ^invention. Apodizers ■ are 
optical systems well known by those skilled in the art, used 
for example as filters "to cover the aperture of an optical 

25 instrument in order to remove the secondary rings of , a 
diffraction pattern. Here, the idea of the present invention 
is to use an apodizer for a different purpose, that is to 
control the angular distribution of a panoramic lens and to 
obtain the non-linearity sought. 

30 In practice, an apodizer can be produced simply by 

means of one or more a- spherical lenses possibly combined 
with a dif tractive surface. This optical group may, for 
example, comprise a planoconcave lens having a concave and a- 
spherical front, a planoconvex lens having its plane side 

35 oriented towards the front, a meniscus having a concave and 
a- spherical front and a dif tractive, convex back. 

Obtaining several non- linear functions Fd' [XI] , 
Fd' [X2] , Fd' [Xi] using a non-linear function Fd defined by 
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the apodizer is performed by a group of lenses of the type 
described above, comprising cylindrical lenses for example. 

Another way of introducing an apodizer into an 
objective lens of the type described above is to provide an 
5 optical system comprising a plane mirror that reflects the 
light beam onto a distorting mirror of concave, a- spherical 
shape, the beam reflected by the distorting mirror being sent 
onto, the image sensor. In this embodiment, the irregularities 
of sphericity that the concave part of the mirror has 
10 determine the angular distribution function Fd sought for the 
intended application (distortion in the centre, on the 
edges ....). 

Generalisation of the correction method and of the 
algorithm 2 

15 It must be noted here that modern computer-assisted 

lens design tools can be used to produce any type of 
objective lens according to the present invention, projecting 
a panorama in the form of an image of any shape covering moire 
pixels than ah image disk, having a linear or non-linear 

20 distribution, function, using direct or indirect optical 
systems (mirrors). 

In. these conditions,, and in anticipation of the 
different models of objective lenses according to the present 
invention that may be made, it is useful to provide a 

25 generalisation of the correction method according to the 
present invention. 

Figure ISA shows the case in which a fish-eye objective 
lens according to the present invention projects onto an 
image sensor a distorted image ID4 of any shape which tends 

30 to be similar to the rectangular shape of the sensor. Several 
curves J(al), J(a2), J(a3), J(a=90°) can be distinguished 
each consisting of image points corresponding to object 
points having the same field angle al, a2 , a3, a=90°. A 
curve G(\|/i) can also be distinguished that represents the 

35 projection of a set of object points located along the same 
axis Xi of angle \|/i, the angle \|/i here being measured in 
relation to one of the two axes of greater spreading X2, X2 ' 
that the objective lens comprises (these axes, not 
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represented, substantially coincide with the two diagonals of 
the image sensor) . It can be seen here that the curve G(v|/i) , 
or projection of the axis Xi onto the image sensor, is not 
rectilinear due to physical defects of the lenses naturally 
5 leading to this distortion. This distortion does not in any 
way hinder the implementation of the correction method 
according to the present invention and only requires the 
plurality of distribution functions Fd[Xi](d) of the 
objective lens according to the present invention being 

10 quantified at the time of the computer-assisted design of the 
objective, lens. This, quantification of the functions Fd[Xi] 
can take the form of a table giving for each object point 
defined by angles \\f , a the position of the corresponding 
image point on the distorted image ID4 . To save on the memory 

15 space of the microcomputer in charge of displaying the image 
ID4 (in;, the form of an interactive image sector .sliding 
tangentially to a sphere portion) , the table can be sampled 
by removing., a certain number of object points. The: 
distribution function Fd[\|/i] (ai) for each object point 

20 removed can. then be calculated by interpolating the • 
distribution functions of the adjacent object points. 

With, reference to Figure 15B, a point P(px,py,pz) will 
be considered as an example that . is the projection onto a 
sphere portion HS of an image point E(i,j.) of an image sector 

25 to be presented on a screen (not represented here) . The point 
P(px,py,pz) has determined angles \\f and a. The angle \|/ is 
the angle that a point "m" that is the projection of the 
point P(px / py / pz) in the plane OXY has relative to the axis 
OX. The angle a is the angle in relation to the axis OZ that 

30 a segment of straight line L passing through the point 
P(px,py,pz) and through the centre O of the sphere portion HS 
has. As explained above, the point P(px,py,pz) is the 
equivalent of an object point of the panorama photographed, 
the centre O of the sphere portion HS is the equivalent of 

35 the centre of the panorama photographed, the segment of 
straight line L is the equivalent of an incident light ray, 
the axis OZ represents the optical axis of the objective lens 
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and the angle a represents the field angle of the object 
point P(px,py,pz). 

It is then considered that the angles a and \j/ are 
between the following angles : 

5 

\|/i<\|/<i|/i+l 
aj<a«xj+l 

and that the distribution functions of the objective lens 
10 have been quantified for the angles ai, ai+1, \|/i, \|/i + l, for 

example in a table Tl partially described below. 

The coordinates (pu,pv) of a point P' (pu,pv) that is 

the projection of the point P(px,py,pz) onto the distorted 

image ID4 , are easy to calculate by interpolation, such as an 
15 interpolation on four values for example : 

pu = [(pu)i,j + (puj. i+l, j + (pu) i, j+1 .+ (pu) i+1, j+1] /4 
pv = . [(pv) i,j + (pvji+l.j + . (pv) i, j+1. + (pv) i+1, j+1] /4 

20 Table Tl 











\|/i+l 




















aj 






(pu)i, j//(pv) i,.j 


(puj.i+l, j// (pv) i+i # j 






aj+1 






(pu) i, j+i// (pv) i/ j+1 


(pu) i+1, j +1// (pv) i+1, j +1 



































Thus, the algorithm 2 described above can be 
generalised by replacing the lines 16 to 19 by the following 
steps: 

25 

[search for the angle i//] 
If px>0 then 

\|/ = arc cos (px/V (px 2 +py 2 ) ) 
if not if px<0 
30 \\f = -arc cos (px/V (px 2 +py 2 ) ) 
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if not if px=0 and py>0 then 
v|/ = k/2 

if not if px=0 and py<0 then 

\|/ = -7l/2 
if not 

\|/ = 0 
End if 

pu = L2 * Fd[v|/] (a) (1) 
pv = L2 * Fd[\|/] (a). (2) 

In these steps, Fd [\\f] (a) (1) designates the coordinate 
"pu" of a point. P' (pu,pv) corresponding to the projection 
onto the image ID4 of a point P(px,py,pz) belonging to the 
hemisphere HS, the point P being itself the projection of a 

15' point E(i, j) belonging to the image sectdr to be displayed 
(not represented in Figure . 15B) ; Similarly, Fd[\|/] (a) (2) 
designates the coordinate "pv" of the point P' (pu,pv) . 

Therefore, the algorithm 2 is generalised to any type 
of objective lens, within the meaning of the present 

20 invention. In the case of a linear elliptic image, 'the.' 
function Fd[i|/](a) can be expressed in the following 
mathematical form and does not require drawing up a 
quantification tablei: 

25 PdCyj (a) = .[cos (\j/).*2* (n/a) * (L1/L2) .; sin (\|/) *2* (n/a) ] 

The example that has just been described shows that an 
objective lens according to the present invention can have 
several axes of greater spreading (X2, X2 ' ) . This example 
30 also shows that the axe or axes of greater spreading are not 
necessarily perpendicular to the axis XI of lower spreading. 



5 



10 



35 



APPENDIX (forming an integral part of the description) 

Table 1 

SI - Acquisition 

- Capturing a panoramic image by means of a still digital 
camera or a digital- video camera equipped with a fish-eye 
objective lens according to the present invention 

=> Obtaining an image ellipsoid (Dl, D2) 

S2 - Transfer of the image file into a computer 

- Transfer of the image file of the image ellipsoid into a 
microcomputer, 

- Storage in the auxiliary storage (optional) 

S3 - Correction of the image ellipsoid 

- Transfer of the image points of the image ellipsoid into a 
virtual image disk of radius D2 comprising more image points 
than an image disk of radius Dl, 

=> Obtaining a classical image disk 

S4 - Digitisation 

- Transfer of the image points -of the image disk into a 
system of axes OXYZ in spherical coordinates 

Obtaining a hemispherical panoramic image 

S5 - Interactive display 

- Determination of the image points of an image sector to be 
displayed 

- Display of the image sector on a display window 

- Detection of the user's actions on a screen pointer or any 
other control means, 

Detection of the user's actions on keys for image 
enlargement , 

- Modification of the sector displayed (sliding the image 
sector displayed on the surface of the hemisphere and/or 
shrinking/expanding the image sector displayed) . 
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Table 2 , 

SI - Acquisition 

- Capturing a panoramic image by means of a still digital 
camera or a digital video camera equipped with a fish-eye 
objective lens according to the present invention 

=> Obtaining an image ellipsoid . , 

S2 - Transfer of the image file into a computer 

- Transfer of the image file of the image ellipsoid into a 
microcomputer, 

r Storage in the auxiliary storage (optional) 

S3 1 - Interactive display with implicit correction of the 
distortions of the initial image 
A - Determination of the colour of the points E(i, j) of an. 
image sector using the points P' (pu, pv) of the image 
ellipsoid: 

1- Determination of the coordinates Ex, Ey, Ez in the 
coordinate system OXYZ of each point E(i, j ) of the image 
sector, 

2- Determination of the coordinates px; py, pz of points 
P(px,py,pz) corresponding to the points E(i, j) projected 
onto a hemisphere, ... / w •■ 

3 - by means of the distribution function Fd of the objective 
lens, determination of the coordinates, in the coordinate 
system O.'UV of the image ellipsoid, of . the . points P ' (pu,, pv) 
corresponding to the projection of the points- P (px,py,pz) on 
the image ellipsoid, 

B - Presentation of the image sector in a display window 

C - Detection of the user's actions on a screen pointer or 
any other control means 

D - Detection of the user's actions on enlargement keys 

E - Modification of the image sector displayed (moving and/or 
shrinking/ expanding the image sector) 
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Table 3 



O Ul. JL J_ aL.C 


Type 


(~* f~\ m rp <3> TTt~ 


Radius of 
curvature 


illlCJUlCOS 


Type of 
glass 


Diameter 


Conic i ty 


Sll 


A- SPHERICAL 




-39.55 


35 




39.5 


-4 . 07 


S12 


SPHERICAL 




-12.74 


1.75 


ACRYLIC 


23 


0 


S21 


SPHERICAL 




14 . 17 


12.93 




0.65 


0 


S22 


SPHERICAL 




4 . 61 


4.87 


ACRYLIC 


6 . 5 


0 


S31 


A- SPHERICAL 




-77.92 


1.19 . 




10 


6.12 


S32. 


SPHERICAL 




11.57 


6.41 


ACRYLIC 


13 


0 


S41 


DIFFRACT I VE 




-9.82 


3 . 75 




17.. 1 


-0 . 555 


S42 


SPHERICAL.. . 




-12.71. 


4. 58 


ACRYLIC 


16.5 


0 


S51 


SPHERICAL 




-19.34 


10.46 




20 


0 


S52 ' 


A- SPHERICAL 




-34.68 


14.69 


ACRYLIC 


25.5 


0 . 0858 


S61 


SPHERICAL - 




-26.35 . 


0.45 




25 . 4 . 


0 


S62 


SPHERICAL 




Infinite 


5.2 


BK7 


25.4 


0 


S7l'. 


TOROIDAL . 


ANAMORPHOSE 


Infinite 


3 




20 


0 : 


S72 


SPHERICAL " 




Infinite " 


3.1. 


BK7 


20 


0 


S81 , . 


SPHERICAL 




Infinite 


8 




16 


o 


S82 


TOROIDAL 


ANAMORPHOSE 


Infinite 


2 


BK7 . 


16 


0 



